Efficient Resource Utilization in Shared-Everything Environments
نویسندگان
چکیده
E cient resource usage is a key to achieve better performance in parallel database systems. Up to now, most research has focussed on balancing the load on several resources of the same type, i.e. balancing either CPU load or I/O load. In this paper, we present oating probe, a strategy for parallel evaluation of pipelining segments in a shared-everything environment that provides dynamic load balancing between CPUand I/O-resources. The key idea of oating probe is to overlap|as much as possible with respect to data dependencies|I/O-bound build phase and CPU-bound probe phase of pipelining segments to improve resource utilization. Simulation results show, that oating probe achieves shorter execution times while consuming less memory than conventional pipelining strategies. 1991 Computing Reviews Classi cation System: [H.2.4] Parallel Database Systems, Query Processing
منابع مشابه
Load Balanced Query Evaluation in Shared-Everything Environments
In this paper, we present data threaded execution, a new strategy to exploit both, pipelining and intra-operator parallelism in shared-everything environments. Data threaded execution is intuitive, straightforward to implement, but resistant against workload estimation errors and resistant against the discretization error of processor scheduling, that conventional strategies suuer from. Further...
متن کاملWeighted-HR: An Improved Hierarchical Grid Resource Discovery
Grid computing environments include heterogeneous resources shared by a large number of computers to handle the data and process intensive applications. In these environments, the required resources must be accessible for Grid applications on demand, which makes the resource discovery as a critical service. In recent years, various techniques are proposed to index and discover the Grid resource...
متن کاملLoad Balanced Query Evaluation in Shared-everything Environments (extended Version)
In this paper, we present data threaded execution, a new strategy to exploit pipelining and intra-operator parallelism in a shared-everything environment. Data threaded execution is very intuitive, straightforward to realize, and resistant against workload estimation errors and against the dis-cretization error of processor scheduling as it appears in conventional strategies. Furthermore, data ...
متن کاملAn Efficient Approach for Bottleneck Resource(s) Detection Problem in the Multi-objective Dynamic Job Shop Environments
Nowadays energy saving is one of the crucial aspects in decisions. One of the approaches in this case is efficient use of resources in the industrial systems. Studies in real manufacturing systems indicating that one or more machines may also act as the Bottleneck Resource/ Resources (BR). On the other hand according to the Theory of Constraints (TOC), the efficient use of resources in manufact...
متن کاملAdaptive Dynamic Data Placement Algorithm for Hadoop in Heterogeneous Environments
Hadoop MapReduce framework is an important distributed processing model for large-scale data intensive applications. The current Hadoop and the existing Hadoop distributed file system’s rack-aware data placement strategy in MapReduce in the homogeneous Hadoop cluster assume that each node in a cluster has the same computing capacity and a same workload is assigned to each node. Default Hadoop d...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1998